Handling OOV words in Arabic ASR via flexible morphological constraints
نویسندگان
چکیده
We propose a novel framework to detect and recognize outof-vocabulary (OOV) words in automated speech recognition (ASR). In the proposed framework a hybrid language model combining words and sub-word units is incorporated during ASR decoding then three different OOV words recognition methods are applied to generate OOV word hypotheses. Specifically, dictionary lookup, morphological composition, and direct phoneme-to-grapheme. The proposed approach successfully reduced WER by 1.9% and 1.6% for ASR systems with recognition vocabularies of 30K and 219K. Moreover, the proposed approach correctly recognized 5% of OOV words.
منابع مشابه
Handling OOV Words in Dialectal Arabic to English Machine Translation
Dialects and standard forms of a language typically share a set of cognates that could bear the same meaning in both varieties or only be shared homographs but serve as faux amis. Moreover, there are words that are used exclusively in the dialect or the standard variety. Both phenomena, faux amis and exclusive vocabulary, are considered out of vocabulary (OOV) phenomena. In this paper, we prese...
متن کاملVariable-Span out-of-vocabulary named entity detection
Out-of-vocabulary named entities (OOV NEs) are always misrecognized by fixed-vocabulary automatic speech recognition (ASR) systems. This has a negative impact on downstream applications such as language understanding and machine translation (MT). Automatic detection of OOV NEs in ASR hypotheses can help mitigate this problem by triggering the use of alternative approaches to acquire and process...
متن کاملClass-Based N-Gram Language Model for New Words Using Out-of-Vocabulary to In-Vocabulary Similarity
Out-of-vocabulary (OOV) words create serious problems for automatic speech recognition (ASR) systems. Not only are they missrecognized as in-vocabulary (IV) words with similar phonetics, but the error also causes further errors in nearby words. Language models (LMs) for most open vocabulary ASR systems treat OOV words as a single entity, ignoring the linguistic information. In this paper we pre...
متن کاملOn the use of morphological analysis for dialectal Arabic speech recognition
Arabic has a large number of affixes that can modify a stem to form words. In automatic speech recognition (ASR) this leads to a high out-of-vocabulary (OOV) rate for typical lexicon size, and hence a potential increase in WER. This is even more pronounced for dialects of Arabic where additional affixes are often introduced and the available data is typically sparse. To address this problem we ...
متن کاملREMOOV: A Tool for Online Handling of Out-of-Vocabulary Words in Machine Translation
REMOOV is a tool for online handling of out-of-vocabulary (OOV) words in statistical machine translation. REMOOV employs four techniques. Spelling expansion and morphological expansion are used to produce alternative in-vocabulary (INV) forms of OOV words. Dictionary term expansion and proper name transliteration produce target translations directly. These techniques can be used to expand the p...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007